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Gaussian Elimination 
P. Danziger 


1 m Equations in n Unknowns 


Given n variables £1, £2,..., £n and n + 1 constants a1, d2,..., Gn, 6 the equation 


aiz + aoto +... 4 Ankn = b 


represents an n — 1 dimensional object in n-space, called a hyperplane. 
We want to consider the situation where we have m such equations 


41X11 A12%2 bie Aintn = by 
Q211 T A22T2 aes Ann = bə 
Ami 21 + Am2%2 + ... F Amnn = bm 


This is called a system of m (linear) equations in n unknowns (or variables). 
We want to find solutions of this system of equations. 


Theorem 1 Given a system ofm equations in n unknowns: 


e Ifm< n then the number of parameters in the solution will be at least n — m. 


(Thus if there is a unique solution we must have m > n.) 


e If m >n the system is called overprescribed. 


Overprescribed systems either have no solution or they contain reduncancy. redundancy means 
that we can find (m — n) equations which can be dropped without affecting the solution. 


If a system of equations has no solution it is called inconsistent 
If a system of equations has at least one solution it is called consistent 


1.1 Coefficient Matrices and Augmented Matrices 


The x; actually carry no information, the system is completely described by the a;; and b;, i = 
1,...m,7 =1,...,n. 

We thus use the matrix of coefficients, wich is an m x n array containing the coefficients of the 
equations. 


Q11 a12 sra Qin 
Q21 A22 ks An 
Ami Am2 --. Amn 
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We also have the Augmented Matrix, which includes the b; on the right: 


Q11 Q12 ain | by 
Q21 Q22 an | be 
Ami Am2 +--+ Amn | Om 


The augmented matrix contains all the information necessary to solve the system. 


1. Find the matrix of coefficients and the augmented matrix for the following system. 


t + 2y = 3z = 1 
+y +z = 1 
a a n =] 0 
This system of equations has coefficient matrix 
1 2 -8 
0 1 1 
1 1 1 
and Augmented matrix: 
1 2 -—3)1 
0 1 11 
1 1 10 
2. Find the augmented matrix for the following system. 
x + =- De i 
+y= z =0 


This system of equations has Augmented matrix: 


1 0 —2]|1 
0 1 -1/0 


3. Given the following augmented matrix find the original system of equations. 


1 2|—3 
0 1] 1 
1 1] 0 
The system is 
x + 2X = —-3 
y = 1 
x+y = 
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This is a system of 3 equations in 2 unknowns. 

It is inconsistent (no solution), since by the second equation y = 1, the third equation then tells us 
that « = —1, but then the first equation states (substituting in x = —1 and y = 1): —1 +2 = 3, 
which is not true. 

Note that each ow of the augmented matrix corresponds to one of the original equations. 

Each column contains the all the coefficients of a given variable in the system. We say that this 
column corresponds to this variable. 


Example 2 
tS! 2S: S80 1 2|—3 
q =] 0 1| 1 
x+y =0 1 1) 0 


The first row corresponds to x, the second corresponds to y and the third corresponds to the 
constants. 


2 Elementary Row Operations 


There are three basic operations we can preform on equations, these correspond to Row Operations 
on the corresponding matrices. 


1. We can multiply an equation by a constant = Multiply a row by a constant. 


2. Add a multiple of one equation to another = replace a row by itself plus a multiple of another 
row. 


3. Interchange the order of equations = Interchange two rows. 


Notation We generally denote the it! row of the matrix by R;. Let c be a constant, and 1 < i,j < m 


then 
Ri — Ri+cR; means replace Row i by row 7 plus c times row j. 


Ri —> cR; means replace row 7 with c times row i. 

Rie Rj means interchange row 7 with row 7. 
Note that preforming any of these operations does not change the solution to the original system 
of equations. 
When using row operations always indicate the operation you have used! 


Example 3 

1. 
1 1 aes Ry > R—2R, ER 3 S 
2 2 33 a a ae 0 0 -3| -3 
1 1 1/1 3 $ 1 0 0 29 -2 
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2. 
1 1 3)/3 2 2 3/3 
2 2 3/3 Ry o Ry — 1 1 3)/3 
1 1 11 1 1 11 
3. 
1 1 313 2 2 3]|3 
1 1 11 1 1 1f1 


Never operate on the same row twice in one step. 


3 Row Echelon Form 


Definition 4 1. A matriz is in Row Echelon Form (REF) if all of the following hold: 


(a) Any rows consisting entirely of 0’s appear at the bottom. 


(b) In any non-zero row the first number, from the left, is a one. Called the leading one or 
pivot. 


(c) In any two successive non-zero rows the leading one on top is to the left of the one on 
the bottom. 


2. A matrix is in Reduced Row Echelon Form (RREF) if it is in REF (all of the above hold) and 


any column containing a leading one is zero in all other entries. 


Example 5 
1. The following are in REF 


1} 1 0 113 3 
0 1 0 0 0/1 
0 1 0 0 0 0 
( 1'1 0 ) ; : 
0 0 |1 0 0 
1| indicates a pivot. 
2. The following are NOT in REF 
1 1 0 113 8 
01 1 00 0 0 
01 1 00 1 1 
1 1 3 k2 
3 0 1 ae 
0 1 
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3. The following are in RREF 


| 
j=) 
© 


oo 
—_ 
=| © 
oOo oO 
CoO WwW 


© oje. © ©j|=e 


1/2 0 
0 0 |1 


indicates a pivot. All of the 0’s in these examples are forced. 


o[H]o 
yx olej 


ji 


4. The following are NOT in RREF 


Lit 0 2 0 3 
0 1) 0 0 0 
0 0 |I 0 0 


© O};F, © Oje 


1| 2 
0 0 


4 The Gaussian Algorithm 


=| GO 
Se 


Clr | N 
Se HI OO 


The following Algorithm reduces an m x n matrix to REF by means of elementary row operations 
alone. 


1. For Each row i (R;) from 1 to m 


(a) If any row j below row 7 has non zero entries to the left of the first non zero entry in 
row 7 exchange row i and j (R; = Rj) [Ensure We are working on the leftmost nonzero 
entry. | 


(b) Preform R; > +R; where c = the first non-zero entry of row i. [This ensures that row i 
starts with a one.| 


(c) For each row j (Rj) below row i (Each j > i) 


i. Preform R; — R; — dR; where 
d = the entry in row j which is directly below the pivot in row i. [This ensures that 
row j has a 0 below the pivot of row i.| 


(d) If any 0 rows have appeared exchange them to the bottom of the matrix. 


5 The Gaussian-Jordan Algorithm 


The following Algorithm reduces an n x m matrix to RREF by means of elementary row operations 
alone. 
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1. Preform Gaussian elimination to get the matrix in REF 
2. For each non zero row i (R;) from n to 1 (bottom to top) 


(a) For each row j (R;) above row i (Each j < i) 


i. Preform R; — R; — bR; where 
b = the value in row j directly above the pivot in row i. [This ensures that row j 
has a zero above the pivot in row i] 


5.1 Gaussian Elimination 
To Solve a system of equations we preform the following steps: 
1. Translate the system to its augmented matrix A. 


2. Use Gaussian elimination to reduce A to REF. Note that the REF form of A has the same 
solution set. 


3. For each column which does not contain a pivot introduce a parameter and set the corre- 
sponding variable equal to that parameter. 


4. Substitute the parameters back into the remaining non zero equations, this will produce a 
solution for the remaining variables. 


The number of pivots in the REF of a matrix A is called the rank of A and is denoted by r or r(A). 
Note that the number of parameters in the solution is equal to n — r. 


Example 6 Solve the following system of equations. 


zı + 2a + 43 = 3 
xı + 38% + 24%, = 5 
2%, + 43 = 6 
Row reduce augmented matrix to REF 
1 2 113 
1 3 215 Ro = Rə = Ry 
02116 
1 2 113 
0 1 1/2 R > R; — 2R» 
0 2 1/6 
1 2 1|3 
0 1 1] 2 
0 0 1|-—2 


For Gaussian elimination use back substitution: 


£1 + 2x TL3 = 3 (1) 
T2 7 


T 

8 8 
w w 
ll Il 
J N 
N 
—_~— 
w N 
YS NEA 
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From (3) z3 = —2, 
From (2) £2 = 2 — 23 = 2 — (—2) = 4 and 
From (1) zı = 3 — 2x3 — 43 = 3 — 2(4) — (—2) = —3. 


5.2 Gaussian-Jordan 


Instead of using back substitution as in Gaussian elimination, we can continue reducing until A is 
in RREF. 

As before, for each column which does not contain a pivot introduce a parameter and set the 
corresponding variable equal to that parameter. 

But now we may read off the other variables with no further work. 


Example 7 Solve the following system of equations. 


Zi + Lg + 3823 = 3 
221 T 22 T 323 = 
my + @% ++ 2% = 1 
We write out the Augmented matrix and use Gaussian-Jordan to reduce it to RREF. 
1 1 3/3 E ee 
2 2 33 
ETH e om 
1 1 3]3 
0 0 -3| -3 R > —4 Rə 
0 0 —2| -2 
1 1 3]3 
00 1f1 Rs — Rs + 2Rə 
0 0 —2]-2 
1 1 3/3 
| 0 0 1)1 Rı > Rı — 3R2 
0 0 00 
1 1 0/0 
0 0 1ļ1 
0 0 00 


We let the variable corresponding to the column not containing a pivot (the second column which 
corresponds to 22) be the free variable. 

Let t € R, set £2 = t, then z3 = 1 (from row 2) and 

zı = —X2 = —t (from row 1). 

Or (21, £2, £3) = (—t,t, 1) 


Example 8 Solve the following system of equations. 


U1 4+3% — 2£3 + 2z5 = 0 

2x1 + 6% — 5x3 — 244 + 4x5 — 3x6 
0X3 + 10x4 T 15x6 

221 6X 8x4 4a5 1826 = 6 


ll Ih 
oN | 
rae 
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The Augmented Matrix is: 


1 3 -2 0 2 00 
2 6 —5 -2 4 —3|-—1 
0 0 5 10 0 15|5 
26 0 8 4 18) 6 


First leading 1 is in the 1,1 position, already 1. 
Get all 0’s below this leading 1 position. 


13 -2 0 2 01] 0 
R, — R,- 2R; 0 0 5 10 0 15|5 
00 4 8 0 18|6 
Get leading 1 in second row. 
1 3 —2 0 2 0O 
00 1 2 0 3/1 
Pa Feed ae 0. ie. COMO Hoes 
00 4 8 0 18/6 
Get all 0’s below second leading 1. 
1 3 —2 0 2 0)0 
00 0 0 0 6/2 
Move row of 0’s to bottom: 
1 3 —2 0 2 0)0 
00 1 2 0 31 
Aer e 006. 9 
00 0 0000 
Get next leading 1. 
1 3 —2 0 2 00 
1 00 1 2 0 3) 1 
ee eet mcm on 
00 0 00 0/0 


Matrix is now in Row Echelon Form. 
Gauss Elimination 


We now use back substitution. The Matrix translates to the following system of equations: 


£1 + 3% — 2£3 + 2£5 = 
£3 + 204 T 326 = 
te = 


wi =e © 
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For each variable corresponding to a column not containing a leading 1, we assign a free variable. 
Let s,t,r E€ R. 
Let z2 = s, £4 = t, £5 =T. 

Then the equations imply: xe = § 

v3 = 1 — 2x4 — 3x5 = 1 — 2t — 1 = —2t So x3 = —2t. 

Ly = —3x2 + 2x3 — 2x5 = —3s + 2(—2t) — 2r. So zı = —3s — 4t — 2r. 
Thus the final solution is: 

(£1, £2, £3, T4, E5, L6) = (—3s — 4t — 2r, s, —2t,t,r, §) 


Gauss-Jordan 


We continue the algorithm to get the matrix in Reduced Row Echelon Form. 
Get 0’s above rightmost leading 1 (in column 6). 


1 3 —2 0 2 00 
00 1 2000 
SEN o 0 A 
00 0 0000 
Get 0’s above next leading 1 (in column 3). 
13 04 2 0/0 
001 2 0 0)0 
FRAN gA 0 he 
0000000 


The Matrix is now in Reduced Row Echelon Form. 
The Matrix translates to the following system of equations: 


£1 + 3£2 + 4xz4 + 275 = 0 
T3 T 2X4 = 0 
Te = i 


For each variable corresponding to a column not containing a leading 1, we assign a free variable. 
Let s,t,r E€ R. 
Let £ = S, £4 = t, £5 =T. 

Then the matrix implies: x = 5 
63 = —2t 

tı = —3£ə — 404 — 2£5 = —3s — 4t — 2r. 

Thus the final solution is 

(£1, £2, £3, T4, T5, L6) = (—3s — 4t — 2r, s, —2t, t, r, 4). 


